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Abstract 



The tails of prehistory probability density in nonlinear multistable 
stochastic systems driven by white Gaussian noise, which has been a sub- 
ject of recent study, are analyzed by employing the concepts of nonstationary 
optimal fluctuations. Results of numerical simulations evidence that the pre- 
history probability density is non-Gaussian and highly asymmetrical that is 
an essential feature of noise driven fluctuations in nonlinear systems. We 
show also that in systems with the detail balance the prehistory probability 
density is the conventional transition probability that obeys the backward 
Kolmogorov equation 
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I. INTRODUCTION 



Recent theoretical and experimental studies of large fluctuations in stochastic sys- 
tems driven by white Gaussian noise have shown that among the different fluctuation paths 
of the system, the most probable optimal fluctuation path plays a crucial role. This is true 
for large output fluctuations, since the probability of encountering such fluctuations peaks 
sharply at the deterministic optimal fluctuation trajectory driven by an optimal realization 
from the random noise bath. 

The most probable fluctuation path, which we will call the stationary optimal path 
(SOP), is the optimal trajectory x s Q t (t; tf,Xf) that brings the system to a given point Xf of 
the phase space at instant tf from the vicinity of the initial attractor x eq , where the system 
has been fluctuating for a long period of time prior to reaching the point rc^.The concept of 
SOP can be traced back to the work of Onsager-Machlup || and has been further widely 
used (see e.g., Ref. [|H!0|])- 

In particular, the SOP determines the quasistationary probability density P eg (xf), ref- 
erenced to the local equilibrium point x eq , that system is located at point Xf under the 
condition that it never left the region of attraction to x eq . Another quantity of interest is 
the transition probability density P(xf, tf] Xq, to) for the system to be at point Xf at tf given 
that it was at x at time t . It follows that P(xf, tf] x , t ) — > P eq (xf) for t — > — oo provided 
xq belongs to the domain of attraction to x eq . 

The distribution of different paths for a nonlinear double well potential has been 
investigated |],|2| through consideration of the so called prehistory probability density 
Ph(xf,tf;xQ,tQ) , that is a conditional probability that system will be brought to final point 
Xf at tf from the vicinity of the equilibrium position x eq via the point xq at intermediate 
instant to. Using the fact that the prehistory probability density reaches its maximum on 
the SOP ending at Xf, then In Ph(xf, tf] xo, t ) has been represented as a power series with 
respect to the deviation of xq from the optimal path. The first term in this series is respon- 
sible for the Gaussian behavior of the Ph(xf,tf]x ,t ) near its maximum. It is apparent 
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that, the the validity of power series expansion requires that the deviation of xq from the 
SOP be sufficiently small. 

Until now there were no attempts to calculate the prehistory probability density outside 
of the Gaussian domain. The region where one can observe the deviation of Ph(xf, t/; Xq, to) 
from the universal Gaussian form is most interesting since it reflects the specificity of the 
particular system. 

Motivated by the fact that the deviation of Ph(xf,tf;xo,to) from the Gaussian form 
has been observed in experiments [Q, in this paper we have performed an analysis of the 
prehistory probability density for a broad range of initial positions xq outside the vicinity of 
the SOP. This approach is based on the calculation of "nonstationary optimal paths", which 
we call the nonstationary optimal trajectories that maximize the value of the transition 
probability considered as a functional of different paths starting at point x at time to and 
ending at point Xf at time tf. We will show below that the nonstationary optimal path 
formalism naturally allows for calculation of the highly non-Gaussian tails of the prehistory 
probability density appearing in nonlinear systems. 

II. NONSTATIONARY OPTIMAL PATHS IN NONLINEAR SYSTEMS 

We will consider a one dimensional stochastic system as it has been the subject of 
modeling in analog experiments QXJ] described by the equation (dimensionless units) 



where U'(x) is the deterministic force induced by the nonlinear double well potential 



x = -U\x) + f(t) 



(1) 



U(x) = -\x 2 + \x* 



(2) 



and f{t) is random Gaussian white noise with the correlation function 



{f(t)f(t')) = D8(t-t'). 



(3) 
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In order to calculate the transition probabilities we make use of Feynman's notion JTTJ] of 
relating the probability functional of the system output fluctuations and the prob- 

ability functional P[f(t)} of the input noise. For Gaussian noise the probability functional 
P[f(t)\ is given by 

Pif^^eM-^j^dtfm (4) 

One can see from Eq.(f|) that P[f(t)], and hence $[a;(£)], reaches its maximum for the most 
probable optimal random field f op t, introduced in Ref. f|, which minimizes the integral 
/ dtf{t) 2 under the constraint that the equation of motion , Eq.([l]), is satisfied and x(t ) = 
XQ,x(tf) = xj. Such a constraint leads to a nonzero value of the optimal noise field f op t{t) 
which would be zero without constraints. We will assume that points xq and Xf belong to 
the region of attraction of the same attractor including any small vicinity of the separatrix. 

The optimal transition probability is given by the most favorable realization of noise 
which brings the system from point (x ,t ) to point (xj,tf), i.e., 

1 /•'/ 

P(xf,t f ;x ,t ) oc exp[-— jf dtfoptit) 2 } (5) 

In order to find the quasistationary probability distribution P eq (xf) one should take the 
limit in Eq.([5|) xq — > x eq , to — > — oo. The corresponding optimal trajectory is a SOP and the 
corresponding optimal field is a quasistationary optimal field fo pt {t). We have 

P*(x t ) oc exp[-^ f ^ dtft pt {tf\ (6) 

Following Ref. we replace f(t) in Eq.(|5|) by its form given by the equation of motion, 
Eq.®. We obtain 

S 

P(x f , t f ] X , t ) OC eX P[-7T^] ( 7 ) 

where S is the action integral 

S = l [ tf dt(x + U'(x)) 2 (8) 
2 J t Q 



Note that in the case of white noise Eq. (^) can be obtained also from the corresponding 
Fokker-Plank equation with the use of WKB approximation flT2" |. The validity of Eqs.([|),([8]) 
corresponds to the limit of low noise intensity for which >> 1. 

Variation of the resulting action integral gives rise to effective dynamics described by the 
Hamiltonian 

H = \x 2 - \u\xf (9) 



and equation of motion 



x- U'{x)U'\x) = (10) 



with boundary condition 



x(t ) = Xq] x(tf) = x f (11) 

Eq . (|10"D is the Euler-Lagrange equation for the functional Eq.(H). 

Solution of Eqs.([10| ) ,([TT| ) represents the nonstationary optimal path x opt (t) between 
points (x ,t ) and (xf,tj) corresponding to finite energy in Eq.(|). The SOP x s opt (t; x f , t f) 
ending at point Xf at £/ represents a partial solution of Eq.([T0|) that satisfies the first order 
differential equation 

dxf 



dt 



U'{x°) (12) 



with boundary conditions 



x 



(t f )=x f ; x(-oo) = x eq (13) 



The solution of Eqs.(|l2l) and Cfl3f) with x eg = —1 for the double well potential given by 
Eq. (§) is the instanton solution (K 



< P M = - , 1 . = -, 2Cexm w 

/ l + Cexp[2t] P J(l + Cexp[2t]) 3 



where the constant C determines the value x s opt (tf) = Xf. The other partial solution of 
the second order differential equation Eq . (|10"1) satisfies the equation % = —U'(x), that 
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is the equation of motion, Eq.(^) without noise. Note that in the general case with a 
nonlinear dependence of U'(x) on x, the solution of Eq.([T0|) can not be presented as a linear 
combination of the partial solutions. 

The nonstationary optimal paths for the potential given by Eq.(Q) have been found 
by numerical integration of Eq.(|TD|) subject to boundary conditions, Eq. (|TT|) . The two 
point boundary value problem has been reexpressed by considering the problem with initial 
conditions x(to) = xo, x(t ) = t> . A minimization procedure has been employed in order to 
find the best value of the initial velocity vq to reach the target point Xf at tf. As a test for 
the calculations the energy conservation law in Eq.(^) has been verified for each trajectory 
obtained. 

In Figs, la and 2a we illustrate the typical nonstationary optimal paths corresponding 
to Xf = —0.1 for different values of x and r = tf — t - For comparison we show also the 
SOP, given by Eq.flllj) (for Xf = —0.1 the constant C=99 in Eq.(|14|) ). As one can see from 



Fig. 2a, the essential feature of the nonstationary optimal trajectories starting at Xq < is 
the possibility of a sign change of the velocity x(t) at an intermediate point of the trajectory. 
For small values of r nonstationary optimal trajectories deviate significantly from the SOP, 
whereas for asymptotically large r they rapidly approach the SOP independently of the 
initial point xq- This behavior can also be understood from the exact solution of Eq.(|l0|) 
for the harmonic potential presented in the next section. 

With the use of Eq.(|l]) and the known temporal form of the nonstationary trajectories 
one can reproduce the corresponding values of the optimal noise field . The values of f op tif) 
for the trajectories shown in Figs, la and 2a are presented in Figs. lb and 2b. 

In the next section the approach above will be used for the calculation of the prehistory 
probability density for a broad range of initial positions Xq. 

III. PREHISTORY PROBABILITY DENSITY 

The prehistory probability density is given by [IJ 
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P h (x f ,t f ;xo,t ) oc exp[- — ( / dtf opt {t,x ,x f ) 2 - dtf s opt {t,x } ) 2 )] (15) 

£y J—oo J—oo 

where the optimal noise field Xq, £/) induces the nonstationary optimal trajectory which 
starts at %eq &t t — — — oo, passes point a?o at t and reaches point Xf&ttj; f^ pt is the stationary 
optimal field that induces the SOP ending at point Xf at tf. Thus we may write 

/to ft f 

dtfo pt (t,x ) 2 + / dtfoptit^o^f) 2 , (16) 
-oo Jto 

and with Eq. ([l5|) , Eq.(^) we arrive at 

p(t , v _ P eq (x )P(x f ,t f ;xo,t ) 

P h {Xf, t f , x , t ) P eq (x f ) ^ ' 

The difference between P h (xf,tj; x , t ) and P(xf, tf] x , t ) is that Ph(xj, tf] x , t ) satis- 
fies the normalization condition with respect to initial points Xq (J dxoPh{xf,tf; Xq, t ) = 1) 
whereas P(xf, tf] x , t ) satisfies the analogous normalization condition with respect to final 
points Xf. Eq.(|l"5"D shows that if xq belongs to the stationary optimal path ending at Xf, 
then both integrals in Eq. (|I5|) are equal and cancel meaning that Ph(xf,tj;x ,t ) reaches 
its maximum on the stationary optimal path ][]]. 

It follows from Eq.fliT|) that P eq (xf) given by Eqs.(^),(|I|),(0) satisfies the principal of 
detailed balance 

P eq (rA 1 

J; J^ = e* P [--(U{x f )-U(x ))) (18) 

and P(xf,tf]Xo,to) is the conventional transition probability that obeys the forward Kol- 
mogorov equation |14| due to the white character of the noise. Then the prehistory probabil- 
ity density should obey the backward Kolmogorov equation and, in fact, does not depend on 
the prehistory. Below we will illustrate this conclusion, which is a consequence of the chosen 
quasiequilibrium value of the initial distribution, on the model system with a quasiharmonic 
potential. In the general case the prehistory probability density does depend on prehistory 
in multistable stochastic systems. 

Note also that being consistent with the concept of optimal fluctuation we assume that 
U(xf) > U (x ) ( a particle is "climbing uphill" ) resulting in occasional fluctuations described 
by the prehistory probability density. 



In Refs. |]|| the partial solution, Eq.fljjD has been used for the evaluation of the prehis- 
tory probability density based on the iterative solution of Eq.flTOj) near the SOP implying 
that the values of (xo — x s opt (t ; Xf,tf)) are not too large. We stress, however, that using the 
formalism above, the prehistory probability density as well as the transition probabilities 
can be evaluated without the limitation on the values of (x Q — x s opt (t ; Xf,tf)). 

Prior to concentrating on the results of numerical calculations for the case of the nonlinear 
potential, Eq.(H), we will present for illustration the simple expressions for P(xj, tj; x , t ) 
and Ph(xf,tf-,xo,to) with the quasiharmonic potential of the form 

r ix 2 , x < i 

U(x) = (19) 
[|(x-2) 2 , x>l 

In this case the solution of Eq . (|10D can be obtained analytically. We have in the domain of 
attraction at x eq = 0, 

Xopt(t) = etf _ t0 ^ to-t^ iW* - x o e ~ tf ) + e _ W - x f e k % x < 1 (20) 

where x op t(t) is the nonstationary optimal path. 
The optimal noise field is of the form 

2e* 



fovM = _ -5=5 (^/e- f0 - xoe-V) (21) 



e «o-tf v 

Note that the two terms in Eq.(|2n) proportional to e* and e~* respectively represent the 
two partial solutions of Eq. (P~0|) . Only the partial solution proportional to e*, which reaches 
a finite limit at to — > — oo, contributes to the SOP. In fact, for to - > — oo, it follows from 
Eq.© that x opt (t) = x s opt (t; x f , t f ) = x/e*^ [g]. 



We obtain from Eqs.@ and (|T 



xr 1 (xf-xae-Qt-* )) 2 , 
P(x f , t f ; x , t ) oc exp[-- _ e _ 2(tf _ U)) ] (22) 



P h {x f , t f ; x , t ) oc exp[-- 1 _ e _ 2(f/ _ fo) — J (23) 
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One can see from Eqs. fl22|) and (|23"D that in the case of the quasiharmonic potential the 
nonstationary optimal path approach reproduces the exact results for the transition prob- 
ability and the prehistory probability density in linear stochastic systems with Gaussian 
noise. Note that the prehistory probability density given by Eq.(|23|) obeys the backward 
Kolmogorov equation . 

The prehistory probability density for the nonlinear potential given by Eq.(^) has been 
calculated numerically with the use of Eq. ([T5|) . Precaution is required, however, since near 
the SOP the exponent in Eq. (fl5|) becomes the small difference of large numbers. In order to 
improve the accuracy of the calculations we may represent the exponent of Ph(xf,tf;xo, to) 
in the form 

/*' dt[f* pt (t, x ) 2 - f: pt (t, x f ) 2 ] + f S dtiUtit, x , x f ) 2 - f: pt (t, x f ) 2 ] (24) 

One can see from Eq.(|2"4]) that if x belongs to the stationary optimal path ending 
at point Xf at tf, then both integrands in Eq.(p4| vanish. The calculated values of 
— D In Ph{— 0.1, 0; xq, — r) are presented in Fig. 3. It is seen that the parabolic character 
of the curves, and hence the Gaussian character of prehistory probability density, takes 
place only in a small region in the vicinity of SOP where the prehistory probability density 
reaches its maximum. In general, the function P/ l (x/, tf, x , t ) is highly asymmetrical, and 
that is the essential feature of the path distribution in nonlinear systems. 

IV. CONCLUSION 

We have shown that the concept of a nonstationary optimal path is an adequate approach 
for the analysis of transition probabilities and prehistory probability density in noise driven 
systems. The concept allows one to analyze the optimal path distribution outside of the 
immediate vicinity of the stationary optimal path. The observed highly asymmetrical shape 
of the prehistory probability density is the essential feature of the fluctuations in nonlinear 
noise driven systems. We hope that this observation will stimulate additional experiments 
on the analysis of optimal path distributions in nonlinear systems. 
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The nonstationary optimal path approach for the analysis of fluctuations in stochastic 
systems should be especially useful for exploring the possibilities of control of fluctuations 
by an external field. It has been shown recently |T5],[l6| that an optimal control field with a 
finite time duration can naturally cooperate with the nonstationary optimal noise such that 
its temporal form coincides with the temporal form of the optimal fluctuations. 
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FIG. 1. The nonstationary optimal path (a) and optimal field (b) for the nonlinear po- 
tential Eq.(^) and r = 2 corresponding to the final point xj = —0.1 and initial points 
xq = — 1 (1); — 1.5 (2); — 0.5 (3). The dotted lines show the stationary optimal path and 
the corresponding optimal field. 

FIG. 2. The nonstationary optimal path (a) and optimal field(b) for the nonlinear po- 
tential Eq.@ and r = 8 corresponding to the final point xt = —0.1 and initial points 
xq = —1 (1); — 1.5 (2); — 0.5 (3). The dotted lines show the stationary optimal path and 
the corresponding optimal field. 

FIG. 3. The activation energy of the prehistory probability density for xj = —0.1 as a function 
of initial position xq; 1)— r = 8, 2)r = 2, 3)r = 1.5, 4)r = 1, 5)r = 0.5. The data for curves 2-5 are 
multiplied by 10. Stars represent the values of 2(U(xo — U(x eq )) and confirm that quasiequilibrium 
distribution takes place for large r. 
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Fig. 2 
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